Web Survey Bibliography
Survey non-response is one possible threat to generalizability of findings and has received considerable attention. Another possible threat to generalizability is item non-response. We were interested in developing an experimental test of various no-opinion options for evaluative tasks and comparing them with conditions which omit the no-opinion options.
Method Respondents: We had 9342 from the Harris Poll Online panel for an online survey. Procedure: Asked about grocery stores visited Assigned store to rate Rated familiarity, liking, recommendation, and likelihood to shop at store Assigned to rating format: 5 out-of-range response conditions - “Not applicable,” “Don’t know,” “Not sure,” “Not familiar with aspect,” “No opinion”, 1 non-mandatory condition, 2 forced response conditions Rated 10 aspects of store (e.g. pharmacy)
Results: The Not Applicable condition had the lowest endorsement of the out-of-range category, while the Don’t Know, Not Sure, Not Familiar, and No Opinion conditions were comparable in endorsement. Both forced response conditions were similar in their endorsement patterns, but were significantly different from the out-of-range response conditions. The forced response conditions had significantly fewer people who endorsed the top two boxes (“Excellent” and “Very Good”) but more people endorsed the bottom three boxes (“Somewhat good”, “Fair”, “Poor”). Correlational Patterns: We found that there were no significant differences between the conditions for the intercorrelations and correlations with the criteria.
Discussion: While the issue of item non-response is multi-faceted, our investigation suggests that the primary effects of allowing non-response is increased usage of the top categories of the scale with evaluative scales.
Homepage - conference (abstract)
Web survey bibliography - Krosnick, J. A. (41)
- Assessing the Accuracy of 51 Nonprobability Online Panels and River Samples: A Study of the Advertising...; 2016; Yang,Y.;Callegaro,M.;Yang,Y.;Callegaro,M.;Chin,K.;Yang,Y.;Villar,A.;Callegaro, M.; Chin, K.; Krosnick...
- Establishing the accuracy of online panels for survey research; 2016; Bruggen, E.; van den Brakel, J.; Krosnick, J. A.
- Moderators of Candidate Name-Order Effects in Elections: An Experiment; 2016; Kim, Nu.; Krosnick, J. A.; Casasanto, D.
- Understanding Society Innovation Panel Wave 7: Results from Methodological Experiments; 2015; Blom, A. G.; Burton, J.; Booker, C. L.; Cernat, A.; Fairbrother, M.; Jaeckle, A.; Kaminska, O.; Keusch...
- Comparing response order experiments with probability and non-probability samples; 2015; Yeager, D. S.; Krosnick, J. A.; Silber, H.
- A critical review of studies investigating the quality of data obtained with online panels based on...; 2014; Callegaro, M., Villar, A., Yeager, D. S., Krosnick, J. A.
- Online panel research: History, concepts, applications and a look at the future; 2014; Callegaro, M., Baker, R., Bethlehem, J., Goeritz, A., Krosnick, J. A., Lavrakas, P. J.
- Improving ability measurement in surveys by following the principles of IRT: The Wordsum vocabulary...; 2012; Cor, K., Haertel, E., Krosnick, J. A., Malhotra, N.
- Improving Question Design to Maximize Reliability and Validity; 2012; Krosnick, J. A.
- How accurate are surveys of objective phenomena?; 2012; Chang, L. C., Krosnick, J. A.
- A Systematic Review of Studies Investigating the Quality of Data Obtained with Online Panels; 2012; Callegaro, M., Villar, A., Krosnick, J. A., Yeager, D. S.
- Measuring americans' issue priorities. A new version of the most important problem question reveals...; 2011; Yeager, D. S., Larson, S. B., Krosnick, J. A., Tompson, T.
- Experiments for evaluating survey questions; 2011; Krosnick, J. A.
- Does mentioning "some people" and "other people" in a survey question increase the...; 2011; Yeager, D. S., Krosnick, J. A.
- Measuring User Satisfaction in the Lab: Questionnaire Mode, Physical Location, and Social Presence Concerns...; 2011; Jans, M., Romano, J. C., Ashenfelter, K. T., Krosnick, J. A.
- Measuring Intent to Participate and Participation in the 2010 Census and Their Correlates and Trends...; 2010; Pasek, J., Krosnick, J. A.
- Assessing the Accuracy of the Face-to-Face Recruited Internet Survey Platform: A Comparison of Behavioral...; 2010; Villar, A., Malka, A., Krosnick, J. A.
- Study of Non-Probability Sample Internet Surveys' Estimates of Consumer Product Usage and Demographic...; 2010; Yeager, D. S., Carter, A., Tewoldemedhin, H., Krosnick, J. A.
- User’s Guide to the Advance Release of the 2008-2009 ANES Panel Study ; 2009; DeBell, M.; Krosnick, J. A.; Lupia, A.; Roberts, C.
- Question and Questionnaire Design; 2009; Krosnick, J. A., Presser, S.
- Attrition in a Face-to-Face Recruited Internet Panel with Substantial Incentives; 2009; Malka, A., Krosnick, J. A., Ackermann, A., Debell, M., Turakhia, C.
- Lessons Learned About How to Accomplish Effective In- Person Recruitment of a Web-Equipped Survey Panel...; 2009; Ackermann, A., Krosnick, J. A., Turakhia, C., Debell, M., Malka, A., Jarmon, R.
- Comparison Study of Probability and Non-Probability Sample Surveys Conducted by Internet and Face to...; 2009; Yeager, D. S., Krosnick, J. A.
- Does Weighting Improve the Accuracy of Data from Non- Probability Internet Survey Panels of People Who...; 2009; Yeager, D. S., Krosnick, J. A.
- National Surveys Via RDD Telephone Interviewing vs. the Internet: Comparing Sample Representativeness...; 2009; Chang, L. C., Krosnick, J. A.
- Scientific Survey Research: Sustainable in an Online World?; 2009; Krosnick, J. A.
- Money for Surveys: What about Data-Quality?; 2009; A.Krosnick, J. A.
- The accuracy of online surveys with non-probability samples; 2008; Krosnick, J. A.
- ‘For Example’: How Different Example Types in Online Surveys Influence Frequency ; 2008; Berent, M., Krosnick, J. A.
- Comparing the Results of Probability and Non-probability Telephone and Internet Survey Data; 2008; Wang, R., Krosnick, J. A.
- “For Example…,” How Different Example Types in Online Surveys Influence Frequency...; 2008; Berent, M., Krosnick, J. A.
- Response option ordering: Reconciliating meanings conveyed by rating scale position and label. Unpublished...; 2007; Garland, P., Krosnick, J. A.
- Vote Over-Reporting: Testing the Social Desirability Hypothesis in Telephone and Internet Surveys; 2005; Holbrook, A. L., Krosnick, J. A.
- The Economist/YouGov Internet Presidential poll.; 2004; Fiorina, M., Krosnick, J. A.
- Telephone versus face-to-face interviewing of national probability samples with long questionnaires:...; 2003; Holbrook, A. L.; C., Green, M. C., Krosnick, J. A.
- Can What We Don’t Know (about “Don’t Know”) Hurt Us?: Effects of Item Non-response...; 2003; Krosnick, J. A., Behnke, C. S., Lafond, C. R., Thomas, R. K.
- The threat of satisficing in surveys: The shortcuts respondents take in answering questions; 2000; Krosnick, J. A.
- Survey research; 1999; Krosnick, J. A.
- Designing rating scales for effective measurernent in surveys; 1997; Krosnick, J. A., Fabrigar, L. R.
- Mail Surveys for Election Forecasting? An Evaluation of the Columbus Dispatch Poll; 1996; Krosnick, J. A.
- Response strategies for coping with the cognitive demands of attitude measures in surveys; 1991; Krosnick, J. A.